Stability of Markov processes nonhomogeneous in time
نویسندگان
چکیده
منابع مشابه
On $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov processes
In the present paper we investigate the $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov processes with general state spaces. We provide a necessary and sufficient condition for such processes to satisfy the $L_1$-weak ergodicity. Moreover, we apply the obtained results to establish $L_1$-weak ergodicity of quadratic stochastic processes.
متن کاملDenumerable State Nonhomogeneous Markov Decision Processes
We consider denumerable state nonhomogeneous Markov decision processes and extend results from both denumerable state homogeneous and finite state nonhomogeneous problems. We show that, under weak ergodicity, accumulation points of finite horizon optima (termed algorithmic optima) are average cost optimal. We also establish the existence of solution horizons. Finally, an algorithm is presented ...
متن کاملAverage Optimality in Nonhomogeneous Infinite Horizon Markov Decision Processes
We consider a nonhomogeneous stochastic infinite horizon optimization problem whose objective is to minimize the overall average cost per-period of an infinite sequence of actions (average optimality). Optimal solutions to such problems will in general be non-stationary. Moreover, a solution which initially makes poor decisions, and then selects wisely thereafter, can be average optimal. Howeve...
متن کاملOn solutions of Kolmogorov’s equations for nonhomogeneous jump Markov processes
Article history: Received 23 February 2013 Available online 27 September 2013 Submitted by U. Stadtmueller
متن کاملon $l_1$-weak ergodicity of nonhomogeneous continuous-time markov processes
in the present paper we investigate the $l_1$-weak ergodicity of nonhomogeneous continuous-time markov processes with general state spaces. we provide a necessary and sufficient condition for such processes to satisfy the $l_1$-weak ergodicity. moreover, we apply the obtained results to establish $l_1$-weak ergodicity of quadratic stochastic processes.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Annales Polonici Mathematici
سال: 1999
ISSN: 0066-2216,1730-6272
DOI: 10.4064/ap-71-1-47-59